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projected  by  the  LED  light  beam  on  the  object  surface.  The  3-D  location  of  the  spot 
on  the  surface  can  be  computed  by  triangulation.  By  doing  this  for  six  LEDs  we 
obtain  a  set  of  six  3-D  points.  Then  by  fitting  a  plane  to  those  points,  the  distance 
and  orientation  of  a  small  portion  of  the  object  surface  are  calculated. 

Since  there  is  no  moving  part  and  the  spot  position  sensor  chip  is  an  analog  sensor 
which  outputs  the  position  of  the  spot  directly  without  scanning  its  field  of  view, 
we  can  realize  fast  operation  of  our  proximity  senso  Currently  the  sensor  can  give 
approximately  1000  measurements  of  distance  and  orientation  per  second  with  precision 
of  0.07  mm  for  distance  and  1.5°  for  surface  orientation.  This  non-contact  proximity 
sensor  will  be  useful  for  such  applications  as  tracing  an  object  surface  by  a  robot 
arm  with  specified  distance  and  orentation  relative  to  the  surface. 


Abjstract 

■  'jfre  have  developed  a  noncontact  proximity  sensor  which  can  measure  the  distance  and  orientation  of  a  surface 
in  a  range  of  four  to  five  centimeters.  The  sensor  is  based  on  the  scheme  of  active  illumination  and  triangulation. 
It  uses  multiple  infrared  LEDs^as  the  light  sources  and  a  PIN-diode  area  sensor  chip  for  detecting  the  spot 
positions.  Six  LEDs  with  optics  for  collimating  the  beam  are  mounted  at  the  sensor  head  The  directions  of  the 
beams  are  aligned  to  form  a  cone  of  light  converging  at  a  distance  of 4.5  cm  from  the  sensor  head  As  each  LED 
is  sequentially  pulsed  the  sensor  chip  detects  the  position,  in  its  field  of  view,  of  the  spot  projected  by  the  LED 
light  beam  on  the  object  surface  The  3-D  location  of  the  spot  on  the  surface  can  be  computed  by  triangulation. 
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By  doing  this  for  six  LEDs  we  obtain  a  set  of  six  3-D  points Then  by  fitting  a  plane  to  those  points,  the  distance 
and  orientation  of  a  small  portion  of  the  object  surface  are  calculated 


Since  there  is  no  moving  part  and  the  spot  position  sensor  chip  is  an  analog  sensor  which  outputs  the  position 
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of  the  spot  directly  without  scanning  its  field  of  view,  we  can  realize  fast  operation  of  etrr  proximity  sensor^ 
Currently  the  sensor  can  give  approximately  1000  measurements  of  distance  and  orientation  per  second  with 
precision  of  0.07  mm  for  distance  and  /.if  for  surface  orientation.  This  non-contact  proximity  sensor  will  be 
useful  for  such  applications  as  tracing  an  meet  surface  by  a  robot  arm  with  specified  distance  and  orientation 
relative  to  the  surface.  ^ _  ft* 
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1.  Introduction 

Recently  considerable  effort  has  gone  into  research  on  rangefinding  sensors.  The  quantity  to  be  measured 
in  range  finding  includes  distance,  surface  orientation,  surface  curvature,  and  additional  surface  properties 
such  as  reflectivity.  Proximity  sensors  grew  from  the  need  to  gain  environmental  information  in  close 
proximity  to  the  robotic  device.  They  occupy  a  unique  niche  in  the  range  of  sensors  in  that  it  bridges  the 
sensing  gap  between  the  gross  imaging  of  vision  systems  and  the  direct  contact  of  tactile  sensors.  The  spatial 
measurement  capability  of  the  proximity  sensor  allows  a  representation  to  be  constructed  of  the  local 
environment 

Many  types  of  proximity  sensors  have  been  built  The  simplest  sensors  are  proximity  switches  capable  of 
merely  detecting  the  presence  or  absence  of  an  object  in  the  sensor’s  proximity.  More  complex  proximity 
sensors  have  the  capability  of  determining  continuous  three-dimensional  position  and  other  information  such 
as  intensity  and  orientation.  Different  proximity  sensors  employ  various  media  including  magnetic  field, 
electric  field,  air  pressure,  ultrasonic  sound,  and  light  Recent  advance  in  inexpensive  electro-optical 
components  also  has  made  optical  methods  attractive. 

Simple  optical  proximity  sensors  can  be  built  based  on  the  sensitive-volume  technique  [1].  The  intersection 
of  a  cone  of  emitted  light  and  the  field  of  view  of  the  detector  forms  a  roughly  cigar-shaped  sensitive  volume 
in  space.  When  an  object  enters  this  sensitive  volume,  light  is  reflected  and  strikes  the  detector,  which 
generates  a  voltage  corresponding  to  the  depth.  One  problem  of  this  technique  is  that  the  detector  output 
tends  to  show  a  bell  shaped  curve  as  a  function  of  the  depth,  and  therefore  two  different  depths  can  give  the 
same  output  which  can  lead  to  confusion.  This  problem  can  be  solved  by  recessing  the  detector  inward  so 
that  only  the  outer  portion  of  the  range  curve  is  used.  A  more  serious  problem  is  that  the  measurement  is 
affected  by  surface  reflectivity  and  surface  orientation. 

To  overcome  some  of  the  limitations  of  the  sensitive-volume  approach,  Okada  recently  developed  a 
proximity  sensor  with  multiple  sources  and  a  single  detector  [3].  It  employs  a  photo  transistor  and  multiple 
miniature  incandescent  lamps  which  are  linearly  placed.  The  light  sources  are  sequentially  lit,  and  the 
emitted  light  is  projected  on  the  object  surface  through  a  pin  hole.  The  diffusely  reflected  light  is  received  by 
the  photo  transistor  through  another  pin  hole.  Therefore  an  individual  pair  of  a  light  source  and  the  receiver 
forms  a  sensitive-volume  sensor.  Okada  has  shown  that  even  though  the  bell  shaped  curve  of  the  receiver 
output  itself  is  sensitive  to  surface  orientation  and  reflectance,  the  distance  at  which  the  output  takes  its  peak 
is  very  stable.  Thus,  the  distance  measurement  is  based  on  the  number  of  the  light  source  for  which  the 
output  becomes  maximum  with  appropriate  interpolation  to  obtain  continuous  measurement  in  between. 
This  sensor  exploits  the  geometrical  arrangement  to  increase  reliability. 


The  proximity  sensor  we  have  developed  differs  from  these  optical  proximity  sensors  in  that  it  employs 
multiple  infrared  LEDs  as  the  light  sources  and  a  PIN-diode  area  sensor  chip  for  detecting  the  spot  positions, 
and  that  it  is  based  on  triangulation.  It  can  gather  information  of  multiple  spatial  point  locations  on  a  local 
surface  patch,  and  therefore  can  also  compute  the  surface  orientation.  The  features  of  this  sensor  include 
simplicity,  high-speed  operation,  versatility,  and  accuracy  due  to  the  redundancy  in  its  geometry.  This  paper 
presents  the  theory,  implementation,  and  performance  of  our  proximity  sensor. 

2.  Design  of  the  Proximity  Sensor 

2.1.  Overview 

Figure  1  is  a  photo  of  the  prototype  of  the  proximity  sensor  we  have  built.  The  configuration  of  the 

proximity  sensor  is  shown  in  Figure  2.  The  sensor  head  consists  of  multiple  light  sources  (six  LEDs  in  the 

case  of  the  prototype  we  have  built),  an  objective  lens,  and  a  sensor  chip  acting  as  a  spot-position  detector. 

The  sensor  is  controlled  by  an  LSI  11  microprocessor.  The  six  light  sources  are  placed  in  a  circular  pattern 

60°  apart  pointing  towards  the  optical  axis  of  the  objective  lens.  Light  sources  are  aligned  so  that  all  six  light 

source  beams  cross  the  optical  axis  at  the  same  point  The  light  beams  thus  form  an  optical  cone.  The  tip  of 

the  cone  is  placed  at  approximately  the  center  of  the  range  of  operation  of  the  proximity  sensor.  Each  light 

source  is  independently  controllable. 

* 

The  objective  lens  and  sensor  chip  form  a  camera  arrangement.  When  an  object  intercepts  the  light  beam, 
the  resultant  light  spot  is  imaged  onto  the  sensor  chip  through  the  objective  lens.  The  sensor  chip  then  gives 
the  spot  position  on  its  active  two-dimensional  face.  Knowledge  of  the  spot  position  on  the  sensor  chip 
(together  with  the  camera  optics)  and  the  trajectory  of  the  light  beam  allow  us  to  perform  triangulation  and  to 
find  the  coordinates  of  the  point  in  three-dimensional  space.  From  the  measurement  of  multiple  points  in  the 
vicinity  we  can  calculate  information  such  as  the  surface  orientation. 

2.2.  Geometry 

Figure  3  shows  the  geometry  of  the  device  involving  the  light  sources,  the  lens,  and  the  sensor  chip  [2].  The 
x-yz  coordinate  system  is  taken  so  that  the  origin  is  at  the  lens  center,  the  z  axis  is  along  the  optical  axis.  The 
light  source  LEDs  are  placed  on  the  x-y  plane  and  their  coordinates  are  in  general  (xs,ys,0).  Their  rays  point 
to  (0, 0,  d)  on  the  z-axis.  and  make  the  angle  0  with  the  z  axis.  Suppose  that  the  optical  system  is  designed  so 
that  the  plane  z  =  d  through  the  converging  point  is  at  the  best  focus  and  that  the  plane  is  imaged  on  the 
sensor  chip  with  a  magnification  factor  M.  To  model  this  imaging  geometry  we  can  imagine  the  sensor  chip  is 
at  2  =  -  Md.  In  this  case,  a  spatial  point  (x,  y,  z)  is  imaged  on  the  sensor  chip  at  (xc  ,yc,  —  Md),  where 


Let  us  take  an  LED  on  the  x  axis;  ie.  at  (xj.O.O),  and  imagine  a  spot  at  (jr,  0,  z)  projected  onto  a  surface. 
Since  die  spot  is  on  the  light  beam, 

z  =  (dtand  —  x)cot$  (2) 


The  spot  generates  its  image  on  the  sensor  at  (or^O,  -  Md).  From  (1)  and  (2)  we  obtain  the  depth  (z)  as  a 
function  of  the  spot  image  location  (xj. 


_ d 

z  1  —  Xf/idU  land ) 


(3) 


We  can  evaluate  how  sensitive  this  measurement  of  the  depth  is  by  calculating  the  amount  of  change  in  the 
image  position  xc  due  to  a  change  in  the  depth  z. 

c  ,Ajc,  ,  cPMtanO  ,A x 

S  =  -  (4) 


The  larger  the  S  is,  the  more  sensitive  the  measurement.  Naturally,  as  (4)  shows,  the  larger  magnification  and 
the  more  slanted  beam  give  a  greater  sensitivity. 


Another  system  parameter  is  the  range  of  depth  measurement  Assuming  the  effective  chip  size  is  L,  this 
can  be  evaluated  by  the  depths  zx  and  z^,  at  which  the  corresponding  spot  images  are  at  the  edge  of  the 
effective  sensor  field,  Le.  xe  -  U 2  and  xe  =  -  U 2.  The  maximum  measurable  range  W  is  therefore  given 


L/(M  land) 

1  -  [U(2dMlanO)Y 


(5) 


Usually,  in  designing  this  device,  the  depth  of  interest  dis  given.  The  magnification  factor  M  and  the  beam 
angle  0  are  design  variables  whose  values  have  to  be  determined.  The  trade-off  in  determining  M  and  0  is 
between  the  measurable  range  of  depth  W  and  the  sensitivity  S.  The  larger  M  and  9  we  choose,  we  have  the 
larger  S  but  smaller  W,  and  vice  versa.  Practically,  however,  W  can  not  be  too  large,  because  it  has  to  be 
within  a  range  of  reasonable  focus  and  distortion  due  to  lens.  The  angle  9  also  should  not  be  too  large, 
because,  if  so,  the  amount  of  return  light  tends  to  be  very  small. 


Having  derived  the  relationships  among  the  system  parameters,  we  have  chosen  the  following  values  for  the 
prototype  we  have  developed: 
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Depth  of  interest 
Size  of  the  sensor  chip 
Magnification 
Focal  legth  of  object  lens 
Range  of  depth 
Sensitivity 


d  -  45  mm 
L  =  11  mm 
M  =  1 


/  =  22.5  mm 

W  =  112  mm  with  zx  =  40.1  mm  and  z2  =  51.3mm 
5  =  1.14  (at  zj  and  .89  (at  Zj) 


2.3.  Light  Source 

Each  light  source  is  comprised  of  a  high  power  infrared  light  emitting  diode  (LED),  an  aperture,  and  a 
converging  lens  as  shown  in  Figure  4.  This  configuration  was  chosen  due  to  its  small  size,  acceptable 
intensity,  and  small  divergence  of  the  beam.  The  light  source  is  designed  so  that  the  smallest  spot  diameter  is 
realized  in  the  operational  range  of  the  proximity  sensor. 


The  LED  used  is  a  Litronix  SFH  400-3.  It  is  a  narrow  beam  ( ±  6°  at  the  half  power  point)  infrared  emitter 
with  950  run  peak  emission  wavelength.  The  LED  is  over-driven  for  a  short  period  of  time  and  the  estimated 
output  power  is  1.5  mW.  The  focal  length  of  the  collimating  lens  is  26mm,  and  together  with  an  aperture  of 
diameter  1.4  mm  we  obtain  a  spot  of  diameter  about  2  mm  in  the  operating  range.  An  elliptical  spot  is  created 
when  the  light  beam  is  projected  onto  a  slanted  surface.  As  will  be  mentioned,  the  elliptical  shape  and  the 
finite  size  of  the  light  spot  do  not  become  a  serious  problem  because  of  the  ability  of  the  sensor  chip  to  find 
the  intensity  center. 

2.4.  Spot  Position  Sensing 

The  camera  configuration  for  detecting  the  spot  position  is  comprised  of  a  two  dimensional  spot-position 
detector  chip  and  a  double  convex  objective  lens.  The  camera  is  covered  by  nonreflective  material  to  reduce 
unwanted  reflections.  The  sensor  chip  is  Hamamatsu  S1300,  which  consists  of  a  planar  PIN  photodiode  with 
homogeneous  resistive  sheets  on  both  sides.  Figure  5  shows  a  simplified  functional  diagram  of  the  sensor 
chip.  The  sensor  chip  has  four  outer  electrodes  (x; ,  x2 ,  yx ,  y2).  When  a  spot  of  light  strikes  the  sensor  chip 
face,  a  photocurrent  source,  /0,  is  generated  at  the  point.  Consider  a  spot  of  light  impinging  on  the  sensor 
chip  face  at  a  point  (jr^  yc)  where  -L/2  <xcyc<  U 2  When  the  four  electrodes  of  the  sensor  chip  are 
terminated  by  identical  resistors,  R&  the  currents  which  appear  at  the  electrodes  are  given  by: 
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assuming  that  the  unit  resistance  of  the  resistive  sheets  is  r  Q/mm.  By  evaluating  the  following  quantities,  Xc 
and  Y(,  we  obtain 


•XI  ' 


"Lrxf 
rL  +  2^, 

..  JrA  ,  ■ 

rL  +  2R0 


?o~  I  &  I xi  =  lyi  lyi 


(7) 


Therefore,  values  of  Xc  and  Ye  give  the  position  of  the  spot  (xc,  yc)  on  the  sensor  chip.  The  amount  of  the 
current  source,  /0,  is  proportional  to  the  intensity  of  the  spot  impinging  on  the  face  of  the  sensor  chip.  We 
can  see  that  the  sensor  chip  intrinsically  finds  the  in  tensity- weighted  center  of  light  distribution.  This  feature 
is  useful  because  the  spot  position  detection  tends  to  be  insensitive  to  defocus  or  deformation  of  the  spot 


The  sensor  chip  requires  a  minimum  light  power  of  approximately  2  microwatts  to  operate.  Only  a  small 
portion  of  the  light  reflected  at  the  surface  reaches  the  sensor  chip.  We  can  estimate  the  power  reaching  the 
sensor  chip  for  a  high  diffuse  reflective  surface  which  is  perpendicular  to  the  optical  axis  as 


where  A  denotes  the  diameter  of  the  aperture  of  the  objective  lens,  /,  the  path  length  along  the  optical  axis, 
and  Ps,  the  light  source  power.  In  our  prototype  sensor,  A  =  10  mm,  and  Ps  =  1.5  mW.  When  the  surface  is 
at  the  center  of  the  measurement  range,  ie,  /  =  45  mm,  Px  can  be  estimated  as  large  as  15juW,  which  is  more 
than  adequate  for  operating  the  sensor  chip.  Using  the  responsivity  .5A/W  from  the  sensor  chip  data  sheet 
we  expect  the  output  current  /„  =  15/iW  x  .5A/W  =  7.5/xA. 


Actually  the  load  resistor  R0  is  the  input  resistance  of  a  current-to-voltage  converter  shown  in  Figure  6.  The 
value  of  the  feedback  resistance  R&  determines  the  conversion  factor  Vou/Iin>  and  the  equivalent  input 
resistance  of  the  circuit  (load  resistance  to  the  chip)  is  given  by  R0  =  Rf/G,  where  G  is  the  open  loop  gain  of 
the  operational  amp.  Notice  from  equation  (7)  that  RQ  should  be  small  enough  compared  to  the  resistance  of 
the  chip  for  accurate  measurement.  Also,  a  smaller  R0  gives  a  faster  response  time.  The  value  of  R/,  was  set 
330  KQ.  With  an  amplifier  of  gain  105,  the  input  impedance  ( R0 )  of  our  current  to  voltage  converter  is 


therefore, 
*o  = 


*L 

G 


330*0 

“To3 


=  3.30 


which  is  far  smaller  than  the  chip  resistance  rL  =  15  KO. 


V 


2.5.  Timing 

The  data  acquisition  proceeds  in  the  following  order:  The  LSI  11  sends  a  signal  to  turn  on  one  of  the  LEDs. 
The  spot  position  sensor  responds  to  the  light  reflected  at  the  object  surface.  When  the  output  of  the  sensor 
circuit  becomes  stable,  the  four  signals  corresponding  to  ,  IX1 ,  Iyl ,  and  Iyl  go  through  sample-and-hold  and 
digitization.  Including  the  software  latency  at  the  LSI  11,  the  data  acquisition  is  done  within  166  /isec,  which 
translates  to  a  maximum  acquisition  rate  of 6000  points/second. 

3.  Calculating  Surface  Location  and  Orientation 

Calculation  of  the  spatial  location  and  orientation  of  the  object  surface  consists  of  three  steps:  triangulation, 
error  correction,  and  plane  fitting.  The  calculation  of  triangulation  and  error  correction  is  repeated  for  each 
of  the  light  sources,  and  plane  fitting  is  done  after  a  set  of  six  measurements  is  obtained. 

3.1.  Triangulation 

Once  we  obtain  the  four  values  of  Ia, Ia, Iyl,  and  Iyl,  we  can  obtain  the  chip  spot  position  (x c,yc)  by 
using  the  equations  (7).  Then,  we  can  determine  the  spatial  coordinates  of  the  spot  by  triangulation.  The  line 
trajectory  of  the  light  beam  is  constant  for  each  LED,  and  the  line  of  sight  of  the  spot  (line  trajectory  of  the 
diflusely  reflected  light  projected  onto  the  sensor  chip)  is  obtained  from  the  chip  spot  position. 

As  shown  in  Figure  7  the  line  of  light  beam  is  defined  by  the  light  source  origin  ]ts  and  the  light  beam 
direction  vector  5*, 

Ps~(xs,ys,  0), 

as  =  (a,,  bs,  cs). 

The  line  of  sight  is  defined  by  the  lens  center  and  the  direction  of  projection:. 

ft  =  (0,0,0) 

ae  =  (x0  ye,  -Md) 

Let  us  denote  the  coordinate  of  tire  spot  position  we  want  to  locate  as 
P  =  Up.z). 

In  theory,  the  two  three-dimensional  lines  (the  light  source  beam  and  the  line  of  sight)  should  intersect  and 
give  the  location  of  the  spot  on  the  surface.  In  reality,  however,  the  two  spatial  lines  thus  obtained  only  come 
very  close  due  to  noise  and  the  simplified  optical  model  being  used.  We  therefore  determine  the  spot  location 
/ton  the  line  of  the  minimum  distance  (ie,  along  the  common  normal)  between  the  two  lines.  The  direction  of 
the  common  normal  is  ?=  a^xi^.  By  noticing  that  p  is  on  the  common  normal,  we  obtain  the  following 
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equations: 

(p-%)  -  (asxa)  =  0 

(f-pe)(acxa)  =  Q  (8) 

(p- p^a  =  \(ps  -  p^a 

0<Xsl. 

X  is  a  factor  to  determine  where  p”is  placed  along  t  depending  on  which  of  the  two  spatial  lines  are  more 
reliable.  In  our  sensor  we  have  chosen  X  to  be  0.5,  that  is.  /fis  half  way  between  the  line  of  the  light  source 
beam  and  the  line  of  sight.  By  solving  the  above  simultaneous  linear  equations  we  obtain  the  spatial  location 
of  a  spot  on  the  surface  for  each  LED. 

3.2.  Error  Correction 

The  optical  model  so  far  used  has  a  few  simplifications:  first,  the  light  source  beam  is  a  line  and  thus  the 
projected  light  spot  is  a  point;  second,  the  camera  optics  has  no  distortion  or  defocus;  and  finally  the  sensor 
chip  is  linear  in  finding  the  chip  spot  position.  Since  various  distortion  and  nonlinearity  exist  in  reality,  the 
spatial  location  /f=(jc,y,z)  of  the  spot  calculated  by  triangulation  above  based  on  this  simplified  model 
includes  errors.  Suppose  that  (7 ,  J,  7)  is  the  correct  location,  and  let  us  put 

J  =  or  +  ex 
7  =y  +  ey 
7  =z+«:. 

It  would  be  very  difficult  to  model  the  cfFect  of  the  departures  from  the  simplified  model  precisely  to 
determine  the  terms  ex,  ty  and  er  However,  since  the  errors  are  repeatable  with  respect  to  the  measured  chip 
position  (xe,  yj,  we  can  model  them  as  a  whole  by  means  of  polynomials.  Error  correction  polynomials  of 
different  orders  were  experimentally  tested.  It  was  found  that  third-order  error  correction  polynomials  gave 
the  best  result  without  prohibitively  large  computation.  Thus  we  use 

e,  =//Wc)  =  anxe3  +  anx2yc  +  anx<y2  +  atiyc}  +  atix 2  +  atixjc  (9) 

+  ar>yc  attxc  ar>yc  atw 

where  t  =  x,y,  z. 

In  the  phase  of  calibration  before  the  actual  operation  of  the  proximity  sensor,  these  polynomials  are  designed 
for  each  LED  using  a  calibrated  data  set  In  the  phase  of  operation,  the  values  ex,  ey,  and  ez  computed  by 
equations  (9)  are  added  to  the  spatial  coordinates  (x,  y,  z)  computed  by  triangulation  to  obtain  the  corrected 
location  of  die  spot 


3.3.  Plane  Fitting 

When  we  have  obtained  the  spatial  coordinates  of  a  spot  on  the  surface  for  each  of  six  LEDs,  we  fit  a  plane 
to  this  set  of  six  points  by  a  least-square  method  and  obtain  the  equation  of  a  three-dimensional  plane  which 
represents  the  local  surface  patch: 


ax  +  by  +  cz  +  0 


(10) 


where  n  =  (a,  b,  c)  is  a  normalized  surface  normal. 

As  shown  in  Figure  8,  the  location  of  the  surface  is  measured  by  the  distance  from  the  origin  to  the  point 
where  this  plane  intersects  the  optical  (z)  axis: 

D=-=r~  <u> 

The  surface  orientation  is  given  by  the  orientation  of  the  surface  normal  of  this  plane,  which  is  expressed 
either  by  the  normalized  vector  /for  by  the  two  angles  (<p,  4>): 


.  .,v?+ir 

<p  =  tan  1 - 

T  c 

=  tan~ 1-^— 


4.  Performance  of  the  Proximity  Sensor 

The  performance  of  the  prototype  proximity  sensor  was  tested  for  a  surface  at  various  distances  and 
orientations.  The  test  surface  was  a  planar  piece  of  white  cardboard.  This  test  plane  is  placed  on  a  precision 
positioning  table  with  an  angular  motion  (resolution  of  1  arc  minute)  and  a  linear  motion  (resolution  of 
0.00254  mm).  The  test  surface  is  moved  from  the  near  limit  of  operation  (41mm)  to  the  far  limit  (51mm)  with 
increment  of  0.5  mm,  and  rotated  from  +  30°  to  -  30°  with  increment  of  2°.  The  rotation  was  about  the  y 
axis:  that  is,  the  surface  normal  vector  stays  on  x-z  plane.  Four  complete  sets  of  data,  each  of  which  covers  all 
the  combinations  of  distance  and  orientation,  w  ere  taken.  The  results  shown  in  this  section  are  the  averages 
over  these  sets.  All  the  testing  is  done  in  a  dark  environment  to  eliminate  extraneous  light 


The  performance  was  evaluated  by  examining  the  following:  The  first  measure  is  a  chip  spot  trajectory  that 
the  intensity  center  of  the  spot  takes  across  the  sensor  chip  face  as  the  surface  is  moved  and  rotated  in  front  of 
the  sensor.  The  second  measure  is  the  ability  to  accurately  locate  spots  for  each  LED  in  three-dimensional 
space.  The  third  measure  is  the  ability  to  accurately  determine  the  distance  and  orientation  of  the  plane  in 
three-dimensional  space.  This  last  measure  is  most  indicative  of  overall  system  performance. 


To  make  the  proximity  sensor  operational  requires  calibration.  At  known  positions  of  the  surface,  the 
center  positions  of  the  light  spots  on  the  surface  were  located  by  using  an  infrared  scope.  This  was  done  only 
for  10  positions  of  the  plane  in  the  orientation  perpendicular  to  the  optical  axis.  For  these  spot  positions  we 


took  the  readings  of  the  sensor  outputs.  From  this  data,  we  determined  the  system  constants  used  in 
triangulation  such  as  line  trajectories  of  light  beams  and  the  coefficients  of  the  error  polynomials. 

Chip  Spot  Trajectory 

Figure  9  shows  the  chip-spot  trajectories  for  a  plane  orthogonal  to  the  optical  axis  moved  various  distances 
without  rotation.  We  moved  the  test  plane  from  the  near  limit  of  operation.  From  the  optical  geometry,  we 
expect  to  obtain  straight  lines  of  trajectories  which  are  60°  apart.  The  figure  has  essentially  this  behavior, 
though  the  light  sources  are  not  completely  aligned.  For  each  trajectory  the  chip  spot  moves  towards  the 
center  of  the  sensor  chip  as  the  plane  approaches  the  point  where  the  light  source  beam  approaches  the 
optical  axis  (d).  The  ends  of  the  trajectories  bend  due  to  nonlinearity  of  the  sensor  chip. 

Chip-spot  trajectories  are  also  measured  when  the  test  plane  is  placed  at  a  fixed  distance  and  is  rotated  from 
+30°  to  -30°.  The  result  is  shown  in  Figure  10,  which  shows  the  behavior  we  expect 

Location  of  Spatial  Points 

The  error  in  locating  spatial  points  is  defined  as  the  difference  between  the  actual  spatial  position  and  the 
measured  spatial  position.  The  actual  spatial  position  is  the  position  at  which  the  light  source  trajectory 
intercepts  the  test  plane.  The  measured  spatial  position  is  obtained  by  performing  triangulation  with  the  error 
correction. 

Quantitative  data  concerning  the  error  in  locating  spatial  points  is  shown  in  Table  1.  The  averages  and 
standard  deviations  of  errors  in  x,y,  and  z  are  shown  for  various  plane  rotation  angles.  The  average  is  taken 
over  all  the  LEDs  and  distances.  We  can  see  that  the  errors  are  very  small  (order  of  .01  mm)  when  the  plane  is 
nearly  perpendicular  to  the  optical  axis,  and  that  they  increase  as  the  plane  is  rotated  further  from  being 
orthogonal  to  the  optical  axis.  This  is  because  the  intensity  center  shifts  from  the  idealized  line  trajectory  of 
light  source  beam.  Of  course  we  must  note  that  in  some  extreme  cases  the  spots  are  out  of  sight  from  the 
sensor  chip.  In  the  normal  operational  range,  the  error  is  in  order  of  0.1  mm.  The  average  error  in  the 
distance  (z)  for  a  particular  LED  (no.  2)  is  shown  in  Figure  11,  which  shows  dependency  of  the  error  on  the 
distance  and  the  angle. 

Distance  and  Orientation  of  Planes 

By  fitting  a  plane  to  the  six  spatial  points  we  determine  the  plane  equation  (10)  above.  The  discrepancy  of 
this  plane  from  the  actual  plane  which  is  derived  by  the  known  position  and  angle  of  the  test  surface  can  be 
characterized  by  two  quantities:  the  error  in  distance  evaluated  by  the  difference  of  the  D  values  defined  by 
(11)  above  for  the  two  planes,  and  the  error  in  orientation  evaluated  by  the  angle  made  by  the  surface  normals 


The  two  types  of  error  in  determining  planes  are  displayed  in  Figure  12  (location  error)  and  in  Figure 
13  (orientation  error):  the  average  error  is  plotted  as  a  function  of  actual  distance  and  orientation.  Table 
2  quantifies  the  error  by  listing  the  averages  and  standard  deviations  vs.  various  actual  plane  angles.  From  this 
data,  we  can  see  the  following.  First,  Figures  12  and  13  show  that  there  is  a  large  circular  region  of  distance 
and  orientation  for  which  the  sensor  operates  with  accuracy.  Within  this  region,  the  error  is  typically  less  than 
0.07mm  in  distance  and  1.5°  in  orientadon.  Second,  the  error  in  determining  the  plane  is  substantially 
reduced  from  that  of  an  individual  point.  The  redundancy  in  measurements  (using  six  points  for  plane 
fitting)  results  in  this  improvement  Third,  the  error  plots  in  Figures  12  and  13  has  a  small  ridge  along  the 
distance  of  43  mm.  This  is  due  to  the  fact  that  the  plane  fitting  actually  has  a  singularity  near  the  tip  of  the 
light  beam  cone  because  all  the  measured  spatial  points  come  very  close.  In  the  prototype,  the  light  sources 
are  not  completely  aligned  and  the  singularity  did  not  show  up  too  conspicuously. 

5.  Conclusion 

We  have  presented  the  theory,  implementation,  and  performance  of  an  optical  proximity  sensor  capable  of 
measuring  locations  and  orientations  of  local  surface  patches.  This  sensor  has  a  precision  of  0.07mm  and  li° 
over  the  range  of  40mm  to  50  mm  and  +30°  to  -  30°.  It  can  generate  up  to  1000  measurements  per  second. 
The  features  of  the  sensor  include  simplicity  in  principle,  fast  speed,  and  precision  by  exploiting  the 
geometrical  redundancy.  The  concept  can  be  easily  extended  to  various  other  configurations  which  are  suited 
for  individual  applications.  Currently  we  are  building  a  new  version  of  the  sensor  by  improving  the  following 
points: 

•  Use  of  modulation  for  operation  under  ambient  light 

•  Use  of  fiber  cables  and  laser  diodes  for  better  light  sources 

•  Use  of  double  cones  for  eliminating  the  singularity  of  plane  fitting 
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Tabic  1:  Tabic  of  the  averages  and  standard  deviations  of  error  in  locating  spatial  points. 


plane  X  error  Y  error  Z  error 

angle  (millimeters)  (millimeters)  (millimeters) 
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Tabic  2:  Table  of  averages  and  standard  deviations  of  error  in  determining  planes. 
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Figure  1:  l*hoto  of  the  prototype  proximity  sensor;  8cm  (dinmeter)  x  10an  (length). 


Figure  2:  Configuration  of  the  proximity  sensor. 
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Figure  4:  Configuration  of  light  source.  With  d  =  45  mm  and  0  =  45°.  the  distance  / 
of  the  best  focus  is  designed  to  be  d/cosO  =  63.6  mm. 
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Figure  5:  Functional  diagram  of  the  sensor  chip. 


